Lecture #16 - That’s all folks! 


° Intro to Graphs 


* Graph Traversals 
— Depth-first 
— Breadth-first 
° Dijkstra’s Algorithm 


Final Exam: THIS Saturday! 
(The Saturday *before* finals week!) 


Graphs 
What’s the big picture? 


A graph ts an ADT that stores a set of entities 
and also tracks the relationships between 


ae can be anything - people, airports, 
street intersections, bank accounts, etc. 


Relationships can be bidirectional (friends) or 
unidirectional (one-way flight from LA to SF) 
and have attributes, e.g., the travel cost from 
LA to SF. 
Graphs can be implemented in many ways 
(linked lists, arrays, hash tables, etc.) and 
there are 100s of algorithms to process them. 


BUT WHY?!? WE 
NEVER PROGRAMMED 
THEM TO DO THIS! 


static bool isCrazyMurderingRobot = false; 


void interact_with_humans (void) { 
if(isCrazyMurderingRobot = true) 
kill(humans); 
else 
be_nice_to(humans); 


Introduction to Graphs 


Each graph holds two types of items: 


Vertices (aka Nodes): 
A vertex might represent a person, a city or a web 


page. 
Edges (aka Arcs): 
An edge simply connects two* vertices to each other. 


gr%s 


War 
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* Technically, an edge could connect a vertex to itself! 


Directed vs. Undirected Graphs 


There are two major types of graphs... 


Directed Graph 
In a directed graph, an edge 
goes from one vertex to 
another in a specific 
direction. 


O-& 


For example, above we 
have an edge that goes 
from the LA vertex to NYC 
vertex, but not the other 
way around. 

(e.g., there may be a flight from LA 
to NYC but not the other way 
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Undirected Graph 
In an undirected graph, all 
edges are bi-directional. You 
can go either way along any 
edge. 


TEO 


For example, Vickie and Ben 
are mutual friends on 
FaceBook. 


(It would be kinda creepy if 
Vickie liked Ben, but not visa- 
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Representing a Graph in Your 
Programs 


The easiest way to represent a graph is with a 
double-dimensional array. 


The size of both dimensions of the array is equal to 
the number of vertices in the graph. 


bool graph[5][5]; 


Each element in the array indicates whether or not 
there is an edge between vertex i and vertex j. 


Representing a Graph in Your 
Programs 


Each element in the array indicates whether or not 
there is an edge between vertex i and vertex j. 


bool graph[5][5]; 


// edge from vertex 0 to vertex 3 (4) 
graph[0][3] = true; 
graph[1][2] = arue; 


graph[3][0] 


O 1 2 3 4 


As you can see, when we set 
array[i][j] to true, it represents a 
directed edge from vertex i to 
vertex j. 


Representing a Graph in Your 
Programs 


Exercise: What does the following directed graph look like? 


Nodes 0 42 2 2 3 


0 True |False 
Te False 
False 


1 
2 True | 


Representing a Graph in Your 


Programs 
Question: 
How do you represent an undirected graph with an adjacency 
matrix? 
It's easy! 
To bi-directionally connect vertices i and j, simply 
set array[i][j] to true and set array[j][i] to true as well! 


graph[0][3] 
graph[3][0] 


true; 
true; 


An Interesting Property of Adjacency Matrices 
Consider the following graph: And it’s associated A.M.: 


Neato effect: If you multiply the 
matrix by itself something cool 
happens! 


The resulting matrix shows us which vertices are exactly two edges 
apart. 


An Interesting Property of Adjacency Matrices 
Consider the following graph: And it’s associated A.M.: 


FYE SURI AHHH BLY 2 SABRY mahawi QxtounaldRaEEY two edges 
again, we'll get all vertices that are exactly 3 edges apart! 
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Another Way to Represent a Graph 


Question: 
How else can we represent a graph (without a 2D 
array)? 


Answer: 


A directed graph of n vertices can be represented by 
an array of n linked lists. This is called an adjacency 
list. 


list<int> graph[n]; 


lf we add a number j, to list number i (e.g., to 
graph[i]), this means that there is an edge from vertex 
i to vertex j. 


> The Adjacency List 


If we add a number j, to list number i (e.g., to 
graph[i]), this means that there is an edge from 
vertex i to vertex | j 


list<int> graph[4]; 

// edge from node 0 to node 3 
graph[0O].push_back(3); 
graph[2].push_back(Q); 
graph[O].push_back(1); 


So for each entry j, in list i, this a Ne 


means that there is an edge from 
vertex | to vertex j. 
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Which Representation Should You 
Use? 


When should you use an adjacency matrix vs. an adjacency list? 


Scenario #1: 

We've got 10,000,000 users who have relationships with each other 
- typically each person is friends with just a few hundred other 
people. 

What would you do? 


Option A: Store the graph in a 10 million by 10 million array? 
(That’s 100 trillion cells) 


Option B: Store your graph in an array holding 
O million linked lists, each holding roughly 500 items? 
(That’s only 5 billion pieces of data) 
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Which Representation Should You 
Use? 


When should you use an adjacency matrix vs. an adjacency list? 


Scenario #2: 
We've got 1,000 cities, with airlines offering flights from 
every city to almost every other city. 


What would you do? 


ption A: Store the graph in a 1000 by 1000 array? 


(That’s 1 million cells) 


Option B: Store your graph in an array holding 
1000 linked lists, each holding roughly 1000 items? 


(That’s also 1 million pieces of data, but it’s more complex) 
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Which Representation Should You 
Use? 


When should you use an adjacency matrix vs. an adjacency list? 


Use an adjacency matrix tf you Use an adjacency list if you 


have lots of edges between have few edges between 
vertices but few vertices vertices and lots of vertices 
(< 10,000 vertices). (> 10,000 verices). 
A graph that has many A graph that has few 
edges between the edges between the 
vertices is called a “dense vertices is called a 
graph”. “Sparse graph”. 


Let’s see examples of both... 
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Dense(r) Graphs 


æ © © 


Friendships on 
Facebook for people 
from Caltech. 
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(Intra-website links) 


ah 


Sparse Graphs 


POS: 


(High-school dating habits) 
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Graph Traversals 


We can traverse graphs just like we traverse binary trees! 


There are two types of graph traversals: 
Depth-first and Breadth-first 


A Depth-first Traversal keeps moving A Breadth-first Traversal explores 


forward until it hits a dead end ora the graph in growing concentric 
previously-visited vertex... then it circles, exploring all vertices 1 away 
backtracks and tries another path from the start, then 2 away, then 3 


away, etc. 


(Dead end) 


(Previously visited!) 


Start Start 


(Previously visited!) 


... and SO On... 
... and so on... 


3 steps awa 
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Depth-first Traversals 


Let’s learn the Depth-first Traversal algorithm first: 


Depth-First-Traversal(curVertex) 


If we've already visited the current vertex 
Return 


Otherwise 


Mark the current vertex as visited 
Process the current vertex (e.g., print it out) 


For each edge leaving the current vertex 
Determine which vertex the edge takes us to 
Call Depth-First-Traversal on that vertex 


} 


(Notice that it’s recursive!) 
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We E We haven’t yet 
visited this visited this Vertex! 


a 
f {—> If we’ve already visited the current vertex 
= Return 


—> Otherwise 


-~ = Mark the current vertex as visited 
—> Process the current vertex (e.g., pr 


But Vertex #2 has 
no outgoing edges... 


So there’s nothing to do! 


— For each edge leaving the current 
Determine which vertex the edge takes 

us to 
br Call Depth-First-Traversal on that vertex 


es 
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Depth-first Traversal Demo 


We haven't yet 
visited this Vertex! 


—Depth-First-Traversal(curVertex) 


uf 


L { >If we’ve already visited the current vertex 


{ Return 
. Alas, Vertex #3 has 
— Otherwise no outgoing edges... 
— Mark the current vertex! so there's nothing to do! 
— Process the current ver 


Determine which vertex the edge takes 
us to 


e> Call Depth-First-Traversal on that vertex 


ele 


== 


. rocessed vertex 3! 
— For each edge leaving the current vertex 
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Vertex #1 has 
no MORE outgoing 


{ 
{ 


Depth-First-Traversal(curVertex) 


If we’ve already visited the current vertex 
Return 


Otherwise 
Mark the current vertex as visited 
Process the current vertex (e.g., print it out) 


— For each edge leaving the current vertex 
Determine which vertex the edge takes 
us to 


sel Call Depth-First-Traversal on that vertex 


} 


+ 


curVertex 


Processed vertex 0! 
Processed vertex 1! 
Processed vertex 2! 
Processed vertex 3! 
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Depth-first Traversal Demo 


—Depth-First-Traversal(curVertex) 
Dt 
{ — If we've already visited the current vertex van 
— Return curvertex 
athere But we’ve already visited |rocessed vertex 0! 
Vertex #3! rocessed vertex 1! 
Mark the current ver So we don’t want to do N rocessed vertex 2! 
Process the current int PEENE ea cieel 
For each edge leaving 
Determine which vertex we a takes 
us to 
Us Call Depth-First-Traversal on that vertex 
} 
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Vertex #0 has 
no MORE outgoing 


Depth-First-Traversal(curVertex) 


If we've already visited the current vertex 
Return 


Otherwise 


Mark the current vertex as visited 
Process the current vertex (e.g., print it out) 


— For each edge leaving the current vertex 
Determine which vertex the edge takes 
us to> 


-> Call Depth-First-Traversal on that vertex 


+ 


Processed vertex 0! 
Processed vertex 1! 
Processed vertex 2! 
Processed vertex 3! 


And we’re done! 


Depth-first Traversal Challenge 


What does a Depth-first Traversal look like on this 
graph? 
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Implementing Depth-first Traversal w/Stack! 


You can also implement your Depth-first Traversal with 
a stack if you like! (What’s not to like???) 


Depth-First-Search-With-Stack(start_room) 
Push start room on the stack 
While the stack is not empty 
Pop the top item off the stack and put it In variable c 
If c hasn’t been visited yet 


Drop a breadcrumb (we’ve visited the current 
room) 
For each door d leaving the room 
If the room r behind door d hasn't been visited 
Push r onto the stack. 


Or does the recursion allow you to simulate a stack? 


Hmmmmmmm! 


28 breadtn-nrst Grapn 
Traversal 


Idea: 


Process all of the vertices that are 1 edge away 
from the start vertex, 


then process all vertices that are two edges away, 
then process all vertices that are three edges away, 


etc... 


Question: 
What data structure could we use to implement this? 


Answer: 
Nota P, buta ? 
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Breadth-first Graph Traversal 


Breadth-First-Search (startVertex) 


Add the starting vertex to our queue 
Mark the starting vertex as “discovered” 
While the queue Is not empty 
Dequeue the top vertex from the queue and place 
INC 
Process vertex c (e.g., print its contents out) 


For each vertex v directly reachable from c 
If v has not yet been “discovered” 

Mark v as “discovered” 

Insert vertex v into the queue 


Hmmm. Does this algorithm look familiar? 


It’s a-maze-ingly similar to our queue- 
based maze-solving algorithm!!! 


30 
Processed vertex O! 


Breadth-first Traversal Demo 


Breadth-First-Search (startVertex) 
{ 


Add the starting vertex to our queue 


Mark the starting vertex as “discovered” 
While the queue is not empty 
—> Dequeue the top vertex from the queue and place 
ine ; 
— Process vertex c (e.g., print its contents ou Paan hA 
Foreach vertex v directly reachable from C\_ this Vertex yet! 
If vPras not yet been “discovered” 
—> Mark v as “discovered” 
Insert vertex v into the queue 
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Processed vertex O! 


Breadth-first Traversal Demo 


Breadth-First-Search (startVertex) 


Add the starting vertex to our queue 
Mark the starting vertex as “discovered” 
While the queue is not empty 

Dequeue the top vertex from the queue and place 


iN C 
=> Process vertex c (e.g., print its contents out) 
Foreach vertex v directly reachable from c 
If vħas not yet been “discovered” 

— Mark v as “discovered” 
Insert vertex v into the queu 


Vertex c has no 
other edges, so 
we're done with it. 


We have 
discovered 


32 
Processed vertex 0! 


Breadth-first Traversal Demo processed vertex 1 


Breadth-First-Search (startVertex) 


Add the starting vertex to our queue 

Mark the starting vertex as “discovered” 
— While the queue is not empty 

—> Dequeue the top vertex from the 

ine 

— Process vertex c (e.g., print its c 

Foreach vertex v directly reacha 

If vħas not yet been “discovered 

— Mark v as “discovered” 


Vertex #1 has no 
more outgoing 


33 
Processed vertex O! 


Breadth-first Traversal DEMO processed vertex 1 


Processed vertex 3! 


Breadth-First-Search (startVertex) 


Add the starting vertex to our queue 
Mark the starting vertex as “discovered” 
— While the queue is not empty 
— Dequeue the top vertex from the queue and place 
in 
— Process vertex c (e.g., print its contents out) 
For each vertex v directly reachable from c 


If v has not yet been “discovered vertex #3 has NO 
Mark v as “discovered” outgoing edges at 
Insert vertex v into the qud all! So we're done. 
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While the queue is not empty 

—> Dequeue the top vertex from the queue 
in" 

—> Process vertex c (e.g., print its conte 

Foreach vertex v directly reachable f 

If vħřas not yet been “discovered” 
—> Mark v as “discovered” 
Insert vertex v into the queue 


Vertex #4 has NO 
outgoing edges... 


more outgoink 


Processed vertex 0! 
Processed vertex 1! 
Processed vertex 3! 


Processed vertex 4! 
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Breadth-first Traversal Challenge 


What does a Breadth-first Traversal look like on this 
graph? 


Ra throory 


reasura 
Room 
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‘Graphs With Weighted Edges 


What does it mean for a graph to have weighted 
edges? 


Definition: Each edge connecting vertex u with 
vertex v has a weight or cost associated with it. 


Question: Why would we want to have weighted 


7  Grapns With Wwelgnted 
Edges 


Definition: The weight of a path from vertex u to 
vertex v is the sum of the weights of the edges 
between the two vertices. 


R900 Question: What’s the cost 
of traveling from LA to NY 


to WA? 


$140 Question: What’s the 
Shortest path from LA to 
WA? 


Definition: The shortest path between two vertices is 
the path with the lowest total cost of edges between 
the two vertices. (The shortest path is a set of 
varticac) 
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Finding the Shortest Path 


Question: How can we find the shortest path 
between any two nodes in a graph? 


Answer: Dijkstra’s Algorithm (the dorm guy?) 
Dijkstra’s Algorithm: 


the length of 
V 


This algorithm determines the shortest path 
(i.e. set of vertices) from a start vertex s to all 
other vertices in the graph. 


So Dijkstra(A) would 

give us a value of 6 for 
A to B, a value of 2 for 
A to C, and 4 for A to D. 
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Dijkstra’s Algorithm 
Input: A graph G, and a starting vertex s 
G may not have any 


negative edge 
values. 


Output: An array called Dist of optimal distances from 
S 
to every other node in the graph. 


-REEE 
o 2 


” Dijkstra's Algorithm: Basic 
Idea 


Dijkstra's algorithm splits vertices in two distinct sets: 
the set of unsettled vertices and the set of settled 


vertices. 
Unsettled vertex: A vertex v is unsettled if we don’t 


know 
the optimal distance to it from the starting 
geile yertex: A vertex v is settled if we have learned 
the optimal distance to it from the starting 


vertex s. 
Initially all vertices 
are unsettled. 


Start vertex 


The algorithm 
ends once all 
vertices are in the 
settled set. 
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Dijkstra on a Graph 


Assume that all vertices are 
infinitely far away to start... 


Since we start at vertex A, 
we know it’s the closest 

vertex to us! How far is it? 
Zero steps away! Wecan Distance 


ne | 0 2|7 
settle it immediately! (Best Enon sorte) DEE 
A BCD 


Now let’s see which unsettled 
vertices 


we CBNs(eQcni Gandy. from A. 
e Cis 2 units away. 
e Dis 7 units away. 


And going directly from A to D is only 7 units away, 
which is less than infinity, so l'Il update this entry 


EAA 


42 


Dijkstra on a Graph 


Ok, so now we know the costs te 
travel to all vertices directly 
reachable from A. 


Which unsettled vertex is closest 
to A? 


Distance o | 
Right! C is closest to A. (Best known so far) 


lf we go directly to C (A [] C), it costs us 2 units. Is 
there any possible way | can travel to C cheaper by 
going through B or through D first? 


So | know that if I travel directly from A to C, at a cost 
of 2 units, that’s the fastest possible route. Therefore 
we can settle C at 2 units. 


: Dijkstra on a Graph 


At this point, we know the 
Shortest path from A to C. 
Now let’s see if we can travel 
through C to reach one of our 
other unsettled vertices 


Bet Slhich unsettled vertices 
Distance 


can be reached directly from ieee ae en 0 Ey 2 T7) 


C? œ° Bis 6 units away. A BCD 
e Dis 2 units away. 


Let’s do D next. We know we can get from A to C in 
2 units, and we can directly go from C to D in 2 
units, SO we can rea in just 4 units! 
Is our new distance to D better than our old one? 
Yup!! Let’s update our table again! 
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Dijkstra on a Graph 


Ok, so now we know the best 
cost to get to all unsettled 
vertices, assuming we travel 
through C. 


Which unsettled vertex is closest 
? 
to A now: Distance 


6 
O 214 
Right! D is closest. a 


A B C D 


If we take the path A [] C [D D, it costs us 4 units. Is 


there any possible way I can travel to D cheaper by 
going through B first? 


So | know that if | travel from A [] C [] D, at a cost of 4 
units, that’s the fastest possible route. Therefore we 
can settle D at 4 units. 
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Dijkstra on a Graph 


At this point, we know the 
Shortest path from A to D. 
Now let’s see if we can travel 
through D to reach one of our 
other unsettled vertices 


(38 ¢Slhich unsettled vertices 
Distance 


er | 6 
can be reached directly from BET 0 6 AR 


D? * Bis 2 units away. A BCD 


Let’s check B. We know we can get from A to D in 4 


units, and we can directly go from D to B in 2 units, 
SO we Can reach B Kjt 6 units! 


Is our new distance to B better than our old one? 
You bet!! Let’s update our table! 
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Dijkstra on a Graph 


Ok, so now we know the best 
cost to get to all unsettled 
vertices, assuming we travel 
through D. 


Which unsettled vertex is closest 
to A now? 


Distance 
(Best known so far) 


Right! B is closest. 


And now that all of our vertices are settled, we are 
guaranteed to have found the minimum travel distances 
to each of our vertices! 
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Dijkstra 


And now l'Il give you the more formal algorithm... 


Born: 11 May 1930, Rotterdam, Netherlands 
Died: 6 August 2002, Nuenen, Netherlands 


Dijkstra’s Algorithm 
Dijkstra’s Algorithm uses 2 data structures: 


1. An array called Dist that holds the the current best 
known cost to get from s to every other vertex in the 


raph. 

Por Bach vertex i, Dist[i] starts out with a value of: 
e O for vertex s 
° Infinity for all other vertices 


Dist romp a 
Idea: We start at node A so 
we're 0 steps away from node 


A. We assume the other 
vertices are infinitely far away 
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Dijkstra’s Algorithm 
Dijkstra’s Algorithm uses 2 data structures: 


2. An array called Done that holds true for each vertex 
that has been fully processed, and false otherwise. 


For each vertex |, Done[i] starts out with a value of 
false. 


G ae A IB IC 
E 0 lœ] 


Doneļ A B C D 
falseļfalseļfalseļfalse 
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Dijkstra’s Algorithm 


hile there are still unprocessed vertices: 
Set u = the closest unprocessed vertex to 
the start vertex s 


Mark vertex u as processed: Done[u] = 
ue. 


We now know how to reach u optimally 
from s 


= A 
Loop through all unprocessed vertices: 
-a 


ost v = the next unprocessed vertex 
If there’s an edge from u to v then 


compare: 

a. the previously computed path from 
Sto—> 

= (i.e. Dist[v]) OR 

b. the path from s to u, and then from 


Dist 
from 
verte 

xs 


to.. 
Doned 


[true}falselfalselfalsd 
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Dijkstra’s Algorithm 


hile there are still unprocessed vertices: 


et u = the closest unprocessed vertex to 
the start vertex s 


Mark vertex u as processed: Done[u] = 


thue. Previous cost: 7 


We now know how to reach u optimally New cost:2 +2 =4 
from s l 


=j A 
Loop through all unprocessed vertices: 
— 


wget v = the next unprocessed vertex 
If there’s an edge from u to v then 


contare: 

a. the previously computed path from 
S to—> 

—>V (i.e. Dist[v]) OR 

b. the path from s to u, and then from 
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Dijkstra’s Algorithm 


hile there are still unprocessed vertices: 


et u = the closest unprocessed vertex to 
the start vertex s 


™Mark vertex u as processed: Done[u] = 


tue. Previous cost: 10 


=pVWWe now know how to reach u optimally New cost:44+2=6 
from s l 


— 
_Ļ00p through all unprocessed vertices: 


set v = the next unprocessed vertex 
If there’s an edge from u to v then 
contare: 
a. the previously computed path from 
S to—> 
—>V (i.e. Dist[v]) OR 


b. the path from s t and.then from , 
And we re done! The Bist array contains the results. 


Old slides [] 


5 Processed Vertex 0 


D e pt h = FI rst Tra Versa Processed Vertex 1 


Processed Vertex 2 


We use a “visited” array to 
track where we've been - this is f 
like checking for a digital ertex 2 has NO outgoing 
breadcrumb! edges... 


So we’ve hit a dead end! 


: // already been ht 
—visited[v] = true; // drop brez b 
—>print(G[v]); // process ver 
} 

— for (each edge e leaving v) { 
u = destination vertex(e); 
DFS(G, u); 

} 


5 Processed Vertex 0 


Depth-First Traversal Processes verex 
ed Vertex 3 


And |bool visited[GRAPH_SIZE] = {false}; 


—>if ( visited[v] == 

return; // alre So we've hit another 
—else { dead end! 
— visited[v] = true; // drop breadc 
— print(G[v]); // process verte 
} 


—for (each edge e leaving v) { 
u = destination vertex(e); 
DFS(G, u); 


5 Processed Vertex 0 


Depth-First Traversal Processes verex: 


And here’s some more C++- 
We’ve now finished 
processing all of Vertex 1’s 
outgoing edges so we’re 
done with it... 


bool visited[GRAPH_SIZE] = 


1 
void DFS(Graph G, int v) 
vol { 


if ( visited[v] == true) 
return; // already been here 
else { 


visited[v] = true; // drop breadcrumb 
print(G[v]); // process vertex v 


— for (each edge e leaving v) { 
u = destination vertex(e); 
—>DFS(G, u); 


Processed Vertex 0 
Processed Vertex 1 
Processed Vertex 2 
Processed Vertex 3 


Woot! 
And we’re done - we’ve 


—if ( visited[v] == true) 
—> return; // already been here 
else { 

visited[v] = true; // drop breadcru 
print(G[v]); // process vertex v 


for (each edge e leaving v) { 
u = destination vertex(e); 
DFS(G, u); 


